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Abstract. Continuous first-order logic is used to apply model-theoretic anal- 
ysis to analytic structures (e.g. Hilbert spaces, Banach spaces, probability 
spaces, etc.). Classical computable model theory is used to examine the al- 
gorithmic structure of mathematical objects that can be described in classi- 
cal first-order logic. The present paper shows that probabilistic computation 
(sometimes called randomized computation) can play an analogous role for 
structures described in continuous first-order logic. 

The main result of this paper is an effective completeness theorem, show- 
ing that every decidable continuous first-order theory has a probabilistically 
decidable model. Later sections give examples of the application of this frame- 
work to various classes of structures, and to some problems of computational 
complexity theory. 

1. Introduction 

Continuous first-order logic was introduced in [3J [I] as a model-theoretic con- 
text sufficient to handle stability theory for so-called "metric structures." These 
are many-sorted structures in which each sort is a complete metric space of finite 
diameter. Key examples include Hilbert spaces, Banach spaces, probability spaces, 
and probability spaces with a distinguished automorphism. 

For classical first-order model theory, there is a meaningful sense of computation 
and effectiveness: In a group, for instance, we have a reasonable algorithmic under- 
standing of a group if the set of triples constituting the Caley table (equivalently, 
the set of words equal to the identity element) is decidable. Of course, there are 
often still many algorithmic unknowns in the group, such as the conjugacy problem 
and the isomorphism problem [9]. The aim of the present paper is to provide a 
similar framework for continuous first-order logic. 

The framework suggested is probabilistic computation. This model of computa- 
tion has seen wide use in complexity theory |14[ 127) , and there is some room for 
hope that an understanding of the relationship between continuous and classical 
first-order logic might yield insights into the relationship between probabilistic and 
deterministic computation. Section [6] gives reasons for such hope. 

Not to get carried away in speculation, though, it is still cause for contentment 
that a way can be found to meaningfully talk about algorithmic information in 
the context of metric structures. The impossibility of finding an algorithm to 
solve arbitrary Diophantine equations (see [19j). the relationship of isoperimetric 
functions to the word problem [211 [5], and much more depend on a notion of 
computation adequate to the context of countable rings (in the case of Diophantine 
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equations) and groups (in the case of the word problem). Some preliminary results 
on specific metric structures, given in Section [5j will suggest that there is ground 
for fruitful research in the effective theory of these structures. 

A key argument that probabilistic computation is the right algorithmic frame- 
work for this context is that it admits an effective completeness theorem. The 
classical theorem is this. 

Theorem 1.1 (Effective Completeness Theorem). A (classically) decidable theory 
has a (classically) decidable model. 

A full proof of this result may be found in |12j . but it was known much earlier, 
at least to Millar [2U] . The main theoretical contribution of the present paper will 
be to interpret the terms of this theorem in such a way as to apply to a continuous 
first-order theory and probabilistic computation. The main result of the present 
paper is the proof in Section |4] of the theorem naturally corresponding to Theorem 

o 

Section [5] will describe the syntax and semantics for continuous first-order logic. 
The reader familiar with [2] or [I] will find nothing new in Section [2] except a 
choice of a finite set of logical connectives (no such choice is yet canonical in con- 
tinuous first-order logic). Section [3] will define probabilistic Turing machines and 
the class of structures they compute. Section [4] will contain the proof of the main 
result. Section O will contain some examples, exhibiting different aspects of the 
information which is conveyed by the statement that a certain structure is prob- 
abilistically computable, and in Section [6] we will conclude with some remarks on 
time complexity of structures. 

2. Continuous First-Order Logic 

We will, in keeping with the existing literature on continuous first-order logic, 
adopt the slightly unusual convention of using as a numerical value for True (or 
acceptance) and 1 as a numerical value for False (or rejection). The authors of [3] 
chose this convention to emphasize the metric nature of their logic. 

Continuous first-order logic is an extension of Lukasiewicz propositional logic. 
The following definitions are from [2J. 

2.1. Semantics. 

Definition 2.1. A continuous signature is an object of the form C = (7Z, T, G,n) 
where 

(1) 1Z and T are disjoint and TZ is nonempty, and 

(2) n is a function associating to each member of 1Z U T its arity 

(3) g has the form {S Sii : (0, 1] -> (0, 1] : s e K U T and i < n s } 

Members of 1Z are called relation symbols, and members of T function symbols. 
We now define the class of structures. 

Definition 2.2. Let C = (TZ, !F,g,n) be a continuous signature. A continuous 
C-pre- structure is an ordered pair 971 = (M, p), where M is a non-empty set, and p 
is a function on 1Z U T such that 

(1) To each function symbol /, the function p assigns a mapping f m : M"'^' — » 
M 
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(2) To each relation symbol P, the function p assigns a mapping f m : M n ^ — > 
[0,1]. 

(3) The function p assigns d to a pseudo-metric d m : M x M — * [0, 1]. 

(4) For each / £ T for each i <nj, and for each e € (0, 1], we have 

Va, 6, c, e [d OT (c, e) < ^ d OT (/ OT (a, c, 6), / OT (a, e, 6)) < e] 

where Z/i(a) = i and lh(d) + lh(b) = rif — 1. 

(5) For each P £ 1Z for each i < np, and for each e € (0, 1], we have 

Va,6,c,e [d OT (c,e) < ^ ^ |P OT (a, c, 6) - P m {a, e, b)\ < e] 

where lh(a) — i and lh(a) + lh(b) = np — 1. 

Definition 2.3. A continuous weak C-structure is a continuous £-pre-structure 
such that p assigns to d a metric. 

Since we are concerned here with countable structures (i.e. those accessible to 
computation), we will not use the stronger notion of a continuous C-structure com- 
mon in the literature, which requires that p be assigned to a complete metric. 
However, it is possible, given a continuous weak structure (even a pre-structure), 
to pass to a completion [5] . 

Definition 2.4. Let V denote the set of variables, and let a : V — > M. Let <p be 
a formula. 

(1) The interpretation under a of a term t (written t m ' a ) is defined by replacing 
each variable x in t by a(x). 

(2) Let i/3 be a formula. We then define the value of ip in 9JI under a (written 
9Jt(<£>, a)) as follows: 

(a) gjt(P(t),<r) :=P m (W^) 

(b) 5[rt(a - /?, a) := max (9Jt(a, ct) - £DT(/3, ct), 0) 

(c) 9Jl(-.a,cr) := 1 -9Jt(a, cr) 

(d) 9Jt(|a,(r) := i9Jl(a,cr) 

(e) ^(supj, a, a) := sup 9Jl(a, <r"), where <r" is equal to cr except that 
(T^(x) = a. 

(3) We write (971, cr) h V exactly when 2rt(v, cr) = 0. 

Of course, if ip has no free variables, then the value of 9Jl(<p, cr) is independent of 

cr. 

2.2. Syntax. 

Definition 2.5. Let So be a set of distinct prepositional symbols. Let S be freely 
generated from Sq by the formal binary operation — and the unary operations -i 
and |. Then 5 is said to be a continuous propositional logic. 

We now define truth assignments for continuous propositional logic. 

Definition 2.6. Let S be a continuous propositional logic. 

(1) if vq : So — > [0, 1] is a mapping, we can extend vq to a unique mapping 
u : <S — > [0, 1] by setting 

(a) v(ip — ip) := max (v(ip) — v(ip),0) 

(b) v(-«p) := 1 - w(^) 

(c) v{\<p) = \v{<p) 
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We say that v is the truth assignment defined by vo- 
(2) We write v \= £ for some SCS whenever v((p) = for all p£E. 

Roughly, if — if has the sense of ^ — > 93. We can also, of course, define if A ip 
as if — {if — ip), and ip V tp via deMorgan's law. We can also define something 
resembling equivalence, \ip — ip\ = {if — tp) V {tp — ip). Lukasiewicz propositional 
logic is the fragment of this logic which does not involve \. 

To make a first-order predicate variant of this logic, we use sup in the place of 
V and inf in the place of 3 (with the obvious semantics, as will be described in 
what follows). We typically also include a binary function d, whose standard inter- 
pretation is generally a metric. Now we give the syntactic axioms for continuous 
first-order logic: 

(Al) {<p - V) - <P 

(A2) {{ x - tp) - ( X - V)) - W - <p) 

(A3) {tp^{tp^ V)) - - - ¥>)) 

(A4) (93 ^ V) - ("^ - -V) 

(A5) \if - fo> - i^) 

(A6) fo> - i^) - i^. 

(A7) (sup,. V' - sup^ if) - sup x {ip - if) 

(A8) ip[t/x] — sup^ if where no variable in t is bound by a quantifier in if. 

(A9) supj. ip — ip, wherever x is not free in if. 
(A10) d{x,x) 
(All) d(a:,») - d{y,x) 
(A12) (d(x,z) -d(a;,y)) -d(y,z) 

(A13) For each / 6 T, each e € (0,1], and each r,q E V with r > e and 

<? < Sf^e), the axiom (g — d{z,w)) A {d{f{x,z,y),f{x,w,y)) — r), where 

l/i(a;) + l/i(y) = n./ — 1. 
(A14) For each P £ K, each e e (0,1], and each r, g € T> with r > e and 

9 < #p,i(e), the axiom (g — d{z, w)) A {{P{x, z, y) — P{x, w, y)) — r), where 

lh{x) + lh{y) = np — 1. 

Axioms A1-A4 are those of Lukasiewicz propositional logic, and axioms A5-A6 
are those of continuous propositional logic. Axioms A7-A9 describe the role of 
the quantifiers. Axioms A10-A12 guarantee that d is a pseudometric, and axioms 
A13-A14 guarantee uniform continuity of functions and relations. We write T hq tp 
whenever if is provable from T in continuous first-order logic. Where no confusion 
is likely, we will write T h if. 

3. Probabilisticly Computable Structures 

If M is a Turing machine, we write M x {n) for the result of applying M to input 
n with oracle x. Excepting the polarity change to match the conventions above, 
the following definition is standard; it may be found, for instance, in |27j . 

Definition 3.1. Let 2 U be the set of infinite binary sequences, with the usual 
Lebesgue probability measure /x. 

(1) A probabilistic Turing machine is a Turing machine equipped with an oracle 
for an element of 2", called the random bits, with output in {0, 1}. 

(2) We say that a probabilistic Turing machine M accepts n with probability p 
if and only if n{x e 2" : M x {n) J = 0} = p. 
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(3) We say that a probabilistic Turing machine M rejects n with probability p 
if and only if fi{x G 2 W : M x {n) J = 1} = p. 

Definition 3.2. Let £ be a computable continuous signature. Let 971 be a con- 
tinuous /^-structure. Let £(9H) be the expansion of £ by a constant c m for each 
m G M (i.e. a unary predicate c m € 1Z where c™(x) := d(x,m)). Then the con- 
tinuous atomic diagram of 9Jt, written D(9Jt) is the set of all pairs (ip,p), where ip 
is a quantifier-free (i.e. sup- and inf-free) sentence in £(9Jt) and VJl(ip, cr) = p. The 
continuous elementary diagram £>*(9Jt) is the same, except that ip is not required 
to be quantifier-free. 

Note that the definition is independent of cr, since a sentence has no free variables. 

Definition 3.3. We say that a continuous pre-structure 9Jt is probabilistically com- 
putable (respectively, probabilistically decidable) if and only if there is some prob- 
abilistic Turing machine T such that, for every pair (ip,p) G D(Wl) (respectively, 
£)*(3Jt)) the machine T accepts ip with probability p. 

Suppose T is a deterministic machine (i.e. one that makes no use of its random 
bits; a classical Turing machine) and 971 a classical first-order structure. Then this 
definition corresponds exactly to the classical definition of a computable structure. 

We cannot do entirely without the probabilistic machines (that is, we cannot 
thoroughly understand probabilistically computable structures using only classical 
Turing machines), as the follwoing result shows. 

Lemma 3.4 (No Dcrandomization Lemma). There is a probabilistically computable 
weak structure 9Jt such that the set {(<p,p) G D(Wl) : p G T>} is not classically 
computable. 

Proof. Let U be a computably enumerable set, and let S be the complement of U. 
We first construct a probabilistically computable function / such that 

p(r(x) = o) = 1 - 

if and only if x € S. At stage t, if x G Ut, pick two strings a t ,T t of length t + 2 
such that ft(x) does not halt with random bits at or Tt- We define the function 
f t+1 : = f t u {f at (x) = 0,f Tt (x) = 1}. On the other hand, if a; € U t , then we 
arrange that f" +1 (x) = for all a of length at most t + 2 where /f(x) does not halt. 

Let / = |J f t . Now if x G 5, we never see x G Ut, so f(x) = with probability 

tew 

\. Otherwise, there is some t such that x G U t — U t -\, and then f(x) = with 
t 

probability 1 - £ > \. 

i=2 

Now we let 9Jt be the structure (w, /), where / is interpreted as a unary predicate 
in the obvious way, and d is the discrete metric. If we could decide membership in 
{{<p,p) G D(SDt) : p G T>} with a classical Turing machine, then we could also decide 
membership in U. □ 

Of course, this same argument could work for any other uniformly computable set 
of reals in place of V. To some extent, though, we could do without the probabilistic 
machines. The following results show that the statement of the No Derandomization 
Lemma is the strongest possible. 
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Proposition 3.5. For any probabilistically computable pre-structure there is 
some (classically) computable function f, monotonically increasing in the second 
variable, and some (classically) computable function g, monotonically decreasing in 
the second variable, such that for any pair Up,p) G D(9JV), we have lim f(ip, s) = p 

s — >oo 

and lim g(tp, s) = p. 

s — >oo 

Proof. Let 971 be computed by the probabilistic Turing machine Tot- Let (<7 s ) sgtlJ 
be an effective list of all strings in 2 <u> . Now we define 

f&,s) :=^(T-M.2-"^)). 

i<s 

The definition of g is symmetric. These clearly have the correct properties. □ 

Functions of the same form as / and g are often seen in classical computable 
model theory [E3 E3 EH CZ] . 

Corollary 3.6. For any probabilistically computable pre-structure 97t, the set of 

pairs, (ip,p) G D(yjl) is the complement of a (classically) computably enumerable 
set. 

Proof. Follows immediately from Proposition 13.51 □ 

These limitations notwithstanding, the definition via probabilistic machines gives 
a more natural continuity with the established literature on continuous first-order 
model theory pQ. In addition, this definition is in any case not dispensable when, 
for instance, time complexity of computation is at issue (see Section [6]). 

4. Effective Completeness 

Theorem II .11 is an important piece of evidence that classical Turing computation 
(or any of the many equivalent concepts) is properly synchronized with classical 
first-order logic. In particular, it asserts that under the minimal, obviously neces- 
sary hypotheses, a classical first-order theory has a model which can be represented 
by a classical computation. The aim of the present section is to prove a similar 
result for continuous first-order logic and probabilistic computation. The following 
analogue to the classical concept of the decidability of a theory was proposed in [5] . 

Definition 4.1. Let £ be a continuous signature and T a set of formulas of C. 

(1) We define 

p° r := sup {Etfaa) : (9Jl,cr) |= T}. 

(2) If T is a complete continuous first-order theory, we say that T is decidable 
if and only if there is a (classically) computable function / such that /(<£>) 
is an index for a computable real number equal to <p° T . 

Theorem 4.2. Let T be a decidable continuous first-order theory. Then there is a 
probabilistically decidable continuous pre-structure 9JI such that 3Jt (= T. 

Proof. The construction of a model 37t is given in [2], by an analogue of Hcnkin's 
method. Our model will be essentially the same, except that some care must be 
taken with effectiveness. The principal content of the theorem consists in showing 
that this structure is probabilistically decidable. We will define a probabilistic 
Turing machine which, for any formula (p, accepts tp with probability %Jl((p). 
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We begin by adding Henkin witnesses. Let T> denote the dyadic numbers in the 
interval (i.e. those of the form -M^ for k, n £ N). 

Definition 4.3. Let L be a set of formulae. Then L is said to be Henkin complete 
if for every formula tp, every variable x, and every p < q 6 V, there is a constant c 
such that 

(sup<£ — q) A (p — tp[c/x]) e T. 

X 

Lemma 4.4. We can effectively extend T to a consistent set T of formulae which 
is Henkin complete. 

Proof. Let Cq — C. For each n, let C n +i be the result of adding, for each formula 
tp in C n , and for each x,p,q as in the previous definition, a new constant c^ x p q y 
We can also extend the theory T, beginning with Tq — T. For each n, the set r n +i 
is produced by adding to T, for each formula tp in C n and each x,p,q as in the 
previous definition, the formula (sup,,, tp — q) A (p — <p[c(<p,x,p,q)/ x ])- Let T = \jT n . 

n 

The consistency of T is demonstrated in [2] . 

Note that this construction is in every way effective. In particular, there is a 
(classically) computable function which will, given p,q £5) and Godel numbers for 
tp and x, give us a Godel number for C( ViXiPiq y Moreover, the set T is (classically) 
computable. □ 

We write C* ={JC n , and C = {<\>p,x,p,q)}- 

n 

Lemma 4.5. We can effectively extend T to a consistent set A such that for all 
formulae tp, ip in C* we have tp — "0 G A or %jj — tp £ A . 

Proof. We set Ao = T. At stage s + 1, for each pair ip,tp of sentences from C* 
such that neither tp — tp nor tp — Tp is in A s , we proceed as follows. Let 9 be the 
conjunction of all elements of A s , and let c be the constants from C which occur 
in (tp — tp) — 6. We then check (effectively, since the theory is decidable), whether 
(Vx ((tp — p) — 8) (x/c))° T = 0. If so, then we add ip — tp to form A s+ i. Otherwise, 
we do so with tp — tp. Now A = (J A s is as required. That this extension is 

s 

consistent is established in [2]. □ 

Definition 4.6. Let A be a set of formulas. We say that A is maximal consistent 
if A is consistent and for all formulae tp, tp we have 

(1) If A I- tp - 2~ n for all n, then tp e A, and 

(2) p — tp <E A or tp — p e A. 

Now let A = U A s , and 

S 

A = {p:\fn[5°hp^2- n }}. 

Now A = A U A is maximal consistent, by construction of A . Let 971 be the model 
of T whose universe is the set of closed terms in C, as in [2] . 

We now define the probabilistic Turing machine G which will witness that 9Jt is 
probabilistically computable. We set — Kq = Aq = Ro = 0. We define the 
functions E(S) = {a D t : r G S} and 



p (s) = E 



2lh(a) 

aes 
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At stage s, if A s h ip — J^, then we will arrange that G accepts ip with probability 
at least 1 — If Kf = 0, then we find 2 n — k nodes <7i, . . . , <J2 n -k of length 
n in 2 <LJ - E(K^), and let Kf +1 = {ax, . . . , cr 2 «-fe}. If is nonempty and 
P(Kf) > 1 - p-, then we do nothing with A A . If A A is nonempty and P(Kf) < 
1 — 7^7, then we find some set E of elements of 2 <UJ — E(K^) with length n so that 
P(A A U E) = 1 - and let A S A +1 = Kf U E. 

If A s h |r - </j then we will arrange that G rejects ip with probability at least 
Jfc. If A^ = 0, then we find fc nodes cii, . . . , cr fc of length n in 2 <w - E(Kf), and 
let Af^ = {ex, . . . , <Tfc}. If Kf is nonempty and P(Af ) > then we do nothing 
with K R . If Kf- is nonempty and P(Kf-) < -J^, then we find some set E of elements 
of 2 <UJ - E(Kf) with length n so that P(Af U E) = and let Af +1 = Af U E. 

At this point, it is necessary to verify that certain aspects of the construction 
described so far are actually possible. In particular, we need to show that when 
we search for elements of 2 <UJ — E(Kf ), for instance, there will be some. Now if 
E(Kf) contains more than 2™ — k\ elements, we must have P(A A ) < 1 — so 
that we must have had A s h <p> — (Note that if A s h ip — p and q > p, then also 
A s h ip - q). 

Lemma 4.7. // there is some s such that A s h <p — ^ and A s h ^ — ip, then 
(1 - |b) + |r < 1- 

Proof. Suppose not. Then 2™ — fci+fc > 1, so that fe — fei > and fc > fei. However, 
we also have — |i = 0, so that fci > fe, a contradiction. □ 

The situation for finding elements of 2 <UJ — E(Kf-) is symmetric. 

Returning to the construction, at stage s, we will add more instructions. We 
will guarantee that for any a G E(Kf), we will have G a (ip) j= 0, and for any 
a £ E{Kf) we will have G (T (^) |= 1. 

Let (p be a sentence in £*, and suppose Tl(ip) = p. We need to show that G 
accepts if with probability p. Since A is maximal consistent, for each qo,qi G T> 
with q$ < VJl(<p) < qi, there was some s for which A s \- ip — qi and for which 
A s h qo — ip, and at that stage, we ensured that G would accept ip with probability 
between go and q\. Since this is true for all qo < p < q\ £ T>, it must follow that G 
accepts ip with probability p. 

□ 

We can strengthen Theorem 14.21 to produce a continuous weak structure if we 
require T to be complete. 

Definition 4.8. Let 971 be a continuous /^-structure. We write Th(9Jt) for the set 
of continuous ^-sentences ip such that Tl(ip) — 0. We say that T is complete if 
T = Th{Wl) for some 971. 

Corollary 4.9. Let T be a complete decidable continuous first-order theory. Then 
there is a probabilistically decidable weak structure 971 such that 971 |= T. 

Proof. If the signature has no metric, then Theorem 14.21 suffices. Otherwise, we 
note that T must contain the sentence sup ((a; = y) — d(x,y)), so that when we 

apply Theorem 14.21 the function d m is a metric on 971. □ 
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5. Examples 

A full treatment of each of the following classes of examples suggests a paper — 
or many papers — of its own. However, in each case some suggestion is given of the 
kind of data given by the assumption that an element of the class is probabilistically 
computable. 

5.1. Hilbert Spaces. A pre-Hilbert space over a topological field F is a vector 
space with an inner product meeting all requirements of being a Hilbert space 
except perhaps that it may not be complete with respect to the norm. The authors 
of pQ identify a pre-Hilbert space H with the many-sorted weak structure 

M(H) = ((B n (H) : n > 1) , 0, {I mn } m<n , {A r } r£i r, +, (•, •}) 

where B n (H) is the closed ball of radius n, the map Imn is inclusion of B m in B n , 
each A r is a scaling function, + and — are the standard vector operations, and (•, •) 
is the inner product. We also write ||a;|| for y/ (x, x), and the structure has a metric 
given by d(x,y) = \ \x — y\\. Of course, the normal case is to let F = R, but this is 
not necessary. Now the pre-Hilbert space H is clearly a continuous weak structure 
in the obvious signature. A true Hilbert space is a continuous structure. 

Theorem 5.1 ( lj. There is a continuous first order theory, IHS, such that the 
following hold: 

(1) IHS is (classically) computably axiomatized 

(2) IHS is complete 

(3) Any two models of IHS with the same infinite cardinality are isomorphic. 

(4) The continuous first-order structures M. that satisfy IHS are exactly the 
infinite- dimensional Hilbert spaces. 

(5) IHS admits quantifier elimination. 

(6) IHS is Lu-stable. 

Since IHS is computably axiomatizable and complete, it must also be decid- 
able. Consequently, Theorem 14.91 shows that there must exist some probabilisti- 
cally computable weak structure satisfying IHS. Clearly one challenge of handling 
Hilbert spaces from a computational viewpoint is the essential uncountability of a 
true Hilbert space. However, computational scientists are generally undaunted by 
this feature, being satisfied with approximations in place of true limits of Cauchy 
sequences. We will adopt a similar approach. The following result is well known 
(see [T7] for a proof). 

Lemma 5.2. For any p, the space L P (W) is separable (i.e. has a countable dense 
subset). 

Let F be a countable topological field dense in R, let H be a separable Hilbert 
space over the reals, and let D be a countable dense subspace of H . We will write 
H F for the restriction of D to the language which includes scalars only from F. It 
is well known that H must have a countable orthonormal basis (see, for instance, 

my 

Proposition 5.3. If H F is probabilistically computable, then there is a probabilistic 
Turing machine which will, given a probabilistically computable countable basis for 
H F , produce a probabilistically computable orthonormal basis for H F . 
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Proof. The proof is precisely an implementation of the Gram-Schmidt process. Let 
(wj)igo; be a probabilistically computable countable basis. Set v\ :— u\. For s > 2, 
at stage s, we set 

V> (u s ,Vi) 
v s := u s - } — — 77-. 

i— 1 

Now is an orthogonal basis for H F . We can normalize to an orthonormal 

basis (vi)^ by setting v t := □ 

5.2. Banach Spaces and Banach Lattices. Certainly, the framework of Sec- 
tion [53] is sufficient, without the inner product, to account for any normed vector 
space as a continuous pre-structure (and thus any Banach space as a continuous 
structure). 

One also sometimes sees some Banach spaces with the additional structure of a 
lattice included. In such a structure, / V g is the pointwise minimum of / and g, 
and / A g is the pointwise maximum. Such an approach is taken in |25l 118] and also 

Fixed point theorems for operators on Banach spaces or appropriate subsets of 
them are an important technique for many non-linear differential equations [101 
[TT1 [231 [22] . It is well-known that the classical Brouwer fixed point theorem is not 
effectively true (that is, roughly, if the convex hull C of a nonempty finite set of 
points in M 71 and a continuous function / : C — ► C are given in a computable 
way, there may still be no algorithm to find a fixed point for /; see [26J. Since the 
countable spaces we are working with are not complete, we cannot hope for an exact 
version of the Banach fixed point theorem. However, the following approximate 
version does hold (the classical proof is described in [10] ; the proof below is a slight 
modification) . 

Proposition 5.4 (Effective Banach Fixed Point Theorem). There is an effective 
procedure which will, given e > 0, a probabilistically computable normed vector space 
X and a computable nonlinear mapping A : X — > X such that 

d(A(u) - A(v)) < jd(u,v) 

for some 7 < 1, produce an element x* such that d(x* , A(x*)) < e. 

Proof. Fix some uq £ X, and let i > log 7 M0 ) ■ Such an i can be found 

effectively by standard approximations. Write Uk for A (uq). Then 

d(A(u i+ i),u i+ i) = d(A(u l+ i),A(ui)) < jd(u i+ i,Ui) < ■ ■ < 7*d(A(u ),«o) < e. 

Let u* = Uj+i, and the result holds. □ 

This shows that approximate weak solutions to certain differential equations (for 
instance, some of reaction-diffusion type, see |10j ) can be found effectively in prob- 
abilistically computable structures. The key insight of this fixed point result is this. 
The traditional view of effective model theory has asked whether a particular the- 
orem is "effectively true." By contrast, the important question for applications is 
more typically whether the theorem is "effectively nearly true." That is, approxima- 
tions are good enough, and often all that is necessary. For solutions of differential 
equations modeling applications, for instance, practitioners often "would rather 
have an accurate numerical solution of the correct model than an explicit solution 
of the wrong model. Explicit solutions are so rare that fast accurate numerical 
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analysis is essential" [28] . While it is not new to observe that classically unsolvable 

problems can be effectively approximated, the framework of probabilistically com- 
putable structures in continuous first-order logic is one that calls attention to the 
possibility of approximate solutions, rather than to the impossibility of exact ones. 

5.3. Probability Spaces. Let X = (X,B,/d) be a probability space. We say 
that B G B is an atom if fi(B) > and there is no B' G B with B 1 C B and 
< /i(-B') < fJ-(B). We say that X is atomless if and only if B contains no atoms. 
Let B be the quotient of B by the relation B\ ~ B^ if and only if [l{B\/\B2) = 0. 
The authors of [T] identified X with the structure 



with the metric d(A, B) = fi(AAB). 

Theorem 5.5 (|1J). There is a continuous first- order theory APA such that 

(1) APA is finitely axiomatizable. 

(2) APA is complete. 

(3) APA admits quantifier elimination. 

(4) The continuous pre- structures satisfying APA are exactly the atomless prob- 
ability spaces, represented as above. 

Since APA is finitely axiomatizable and complete, it is also decidable. Thus, 
Theorem 14. 91 gives us a probabilistically decidable model. Of course, any separable 
probability structure can be approximated by a countable dense set. 

A standard issue in effective model theory is whether two isomorphic structures 
must be isomorphic via a computable function. The following result shows that the 
answer for probability structures is affirmative. 

Proposition 5.6. Let 25 and £ be isomorphic, probabilistically computable atom- 
less probability structures with universes B and C, respectively. Then there is a 
(classically) computable function witnessing the isomorphism. 

Proof. The isomorphism is constructed by a standard back-and- forth argument. 
Suppose that / : 25 — > £ is a finite partial isomorphism, and that x £ B — dom(f). 
We wish to find some y e C such that / U {(x, y)} is still a partial isomorphism. 
Without loss of generality, we may assume that x is not in the substructure of 
23 generated by dom(f). Let ao,. .. ,a n be the atoms of the substructure of 25 
generated by dom(f). We may assume, without loss of generality, that each ai is in 
dorn(f). Now the isomorphism type of x is determined by the values ^{xdai). Since 
B is atomless, there is an element y G C such that for each i we have n Oj) = 

/i £ (j/n/(aj)), and since 25 and £ are probabilistically computable, we can effectively 
find this y. The extension to a new element of £ is entirely symmetric. The union 
of the partial isomorphisms constructed in this way will be a computable function, 
and will be an isomorphism from 25 to £. □ 

5.4. Probability Spaces with a Distinguished Automorphism. A standard 
sort of enrichment in stability theory is to expand a known structure by adding a 
new function symbol to define a new function, and to specify that this function be 
generic. Fix an interval / under the Lebesgue measure A, and let £ be the algebra 
of measurable sets. Let G denote the group of measure preserving automorphisms 
of (/,£, A), modulo the relation of almost everywhere agreement. Let r G G. Now 
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r induces an automorphism on (L, 0, 1, - c , fl, U, A) in a straightforward way (see 
[H[T]). We say that r G G is aperiodic if for every positive integer n we have 

\{xel :T n (x) = x} = 0. 

To have a countable structure of this type, we could take a countable dense subset 
V C I, and for X C set A(X) = X(cl(X)). 

In [3] and pQ, an axiomatization is given for the theory of atomless probability 
spaces with a distinguished aperiodic automorphism. This theory is complete and 
admits elimination of quantifiers. The authors of [4] show that entropy arises as a 
model-theoretic rank. 

The result below partially describes the degree of algorithmic control we can 
expect on iterations of such an automorphism. Before stating the result, though, a 
probabilistic analogue to computable enumerability should be given: 

Definition 5.7. We say that a set is probabilistically computably enumerable if 
and only if there is some probabilistic Turing machine M such that 

• If x G S, then for any q < 1 the machine M accepts x with probability at 
least q, and 

• If x ^ S, then there is some q < 1 such that M accepts x with probability 
at most q. 

In particular (and especially in light of the time complexity considerations in 
Section [6]), if we specify an error tolerance q, there is some s such that M(s,x) is 
below q whenever x G S, and (assuming the tolerance is sufficiently small) no such 
s otherwise. 

Theorem 5.8. Let X = (L. 0, 1, - c , D, U, A, r) be a probabilistically computable prob- 
ability structure based on a dense subset of the unit interval, with a measure- 
preserving transformation r. Let A C I be a set of positive measure, defined without 
quantifiers in continuous first-order logic. Write 21 for the set [J T n (A). Then for 

any isomorphism f : X — > J to a probabilistically computable structure J , the set 
/(2t) is probabilistically computably enumerable. 

Proof. Toward part 1, note that 21 is defined by the infinitary disjunction 

tp(x) - \/ T~ n {x) e A 

and that the set A is defined by a quantifier-free continuous first-order formula. 
The isomorphism / must preserve satisfaction of if — that is, X \= ip(x) if and only 
if J |= (p(f(x)). Now let M be a probabilistic Turing machine such that M(x,s) 
is the minimum value of /\ r~ n {x) G A, where k ranges over all numbers less 

n<k 

than or equal to s. Then M witnesses that /(2l) is probabilistically computably 
enumerable. □ 

6. Time Complexity of Structures 

One of the most important applications of probabilistic Turing machines is their 
role in computational complexity theory (see [T6J ETJ [14] ) . Let P be some decision 
problem. We say that Q is of class RP if and only if there is a probabilistic Turing 
machine Mq, halting in time polynomial in the length of the input, such that if 



METRIC STRUCTURES AND PROBABILISTIC COMPUTATION 



13 



x G Q, then Mq accepts x with probability at least |, and if x Q, then Mq 
rejects x with probability 1. This class has the property that P C RP C NP. Q 

Another complexity class of interest is the class BPP. We say that Q is of class 
BPP if and only if there is a probabilistic Turing machine Mq, halting in time 
polynomial in the length of the input, such that if x G Q, then Mq accepts x with 
probability at least |, and if x Q, then Mq rejects x with probability at least §. 
Here we know that RP C BPP CSjn Ilf . 

Definition 6.1 (Cenzer-Remmel [8]). Let A be a computable structure. We say 
that A is uniformly polynomial time if the atomic diagram of A is a polynomial 
time set. 

Clearly, A G P if and only if the structure (w, A) is polynomial time. Also, for 
any polynomial time structure 37t and any quantifier- free definable A C 971", we 
have A G P. We can extend Definition 16.11 in a routine way for probabilistically 
computable structures. 

Definition 6.2. We say that a probabilistically computable structure is polynomial 
time if and only if there is some probabilistic Turing machine T such that, for every 
pair (tp,p) G D(VJl) the machine T halts in polynomial time and accepts tp with 
probability p. 

Now we can characterize the members of BPP in terms of continuous weak struc- 
tures. 

Theorem 6.3. The class BPP can be identified with the class of quantifier-free 
definable sets in polynomial time probabilistically computable structures in the fol- 
lowing way: 

(1) Let A G BPP be a subset of u>. Then there is a polynomial time proba- 
bilistically computable weak structure 971 and a polynomial time computable 
function f : lo — > 971 such that there is a quantifier -free formula <p(x) such 
that ip(x) < j for x G f(A) and <p(x) > § for x G 971 - f(A). 

(2) Let 971 be a polynomial time probabilistically computable weak structure, and 
let A, B be quantifier-free disjoint definable subsets ofDJV 1 , where 

inf {d(x, y) : x G A, y G B} > 

and AU B is classically computably enumerable. Then A and B are each 
of class BPP. 

Proof. Toward the first point, let M be a probabilistic Turing machine witnessing 
that A G BPP. We let 971 be the structure (u,A), where A is a unary predicate 
and A(x) is the probability that M accepts x. We give 971 the discrete metric. 

For the second point, let A be defined by <p(x), and B by tp(x). Now for a G AUB, 
to check whether a G A, we compute 9Jl(cp(a) — ij)(a)). The computation runs in 
polynomial time, and a is accepted with probability at least ^ + inf {d(a, y) : y G B} 
when a £ A and with probability at most \ — inf {d(a, y) : y G B} when a G B. □ 



In both this and the succeeding paragraph, the particular fraction ^ is not critical. Using a 
so-called "Amplification Lemma," any fraction above and bounded away from h will do |27| . 
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